Regular Coalition Formation∗

I study a class of stochastic games of bargaining and coalition formation with finite state space and continuous agreement sets. Equilibria may involve mixing on the part of proposers and coalition partners and the possibility of delay, and can support the entire spectrum of feasible coalitions. After removing inconsequential multiplicities of equilibrium, I establish that outside a closed, measure zero set of parameters there exists a finite, odd number of equilibria and each equilibrium is locally expressible as a smooth function of model parameters.